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ABSTRACT 


This study evaluates and compares the production use of 
three nonlinear programming codes. The three codes and 
their developers are: SUNT by W.C. Mylander, R.L. Holmes and 
G.P. McCormick, GRG by L.S. Lasdon, A.D. Waren, M.W. Ratner 
and A. Jain, and GRAVES by G.W. Graves. This is the first 
computer ccompariscn of these three particular codes. Each 
code was evaluated with respect to the time and 
sophistication required of the user and the degree of 
mandatory or potential interaction between the code and the 
analyst. The comparison criteria were accuracy, robustness, 


efficiency and ease of utilization. 


Eight current and realistic test problems employing 


from 9-100 variables and 2-20 constraints were used. 


The results revealed that no single code was Superior 
Ob anterior in all aSpects. The choice of an optimal code 
among these three would be dependent upon the problems to be 
solved, the ability of the analyst and the desire of the 


analyst to alter the code for his own purposes. 
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This study compares and evaluates the production use of 
three nonlinear programming codes. The analyst was not an 
author of any of the codes, had some prior programming 
experience in a standard classroom context but had no 
previous exposure to a production nonlinear programming code 


Or numerical solution of nonlinear programming problems. 


Obtaining a solution to a nonlinear problen of more 
than a few variables reguires the utilization of two 
components: an algorithm coded for a computer and an analyst 
with an understanding of the problem for which a solution is 
desired. Finding the solution for a nonlinear problen 
requires an interaction between the man and the code-a 
ccmplex interaction with subtle relationships between each 
component. Every problem will require a different degree of 
expertise frem both the analyst and tne code and it is 
precisely this variation petween problems that prevents the 
Separation of the analyst's responsibilities from those of 
the nonlinear programming code. Excellent nonlinear 
programming production codes’ provide a Nut eed € of 
approaches, but the analyst is the one controlling the 
avenue selected. A production type code has to be general. 
meecode must be able to respond to the variation in problem 
Characteristics: in variables, many or few, objective 
function, ilinear or highly nonlinear, constraints, many, 
few, linear, nonlinear, equality or inequality. An adequate 
code is able to handle all of these possibilities witn some 
degree of success. In many instances however, the degree of 
success is dependent upon the ability of the analyst and his 
familiarity with the internal actions and reactions of the 


code and its mathematical approach. 


A user of a nonlinear programming code must be able to 





communicate with the code, he must be able to provide the 
code with a useable interpretation of the problem and he 
must be able to interpret the results provided by the code. 
This requires the ability to program the problem in the 
computer language employed by the code, the ability to 
compute derivatives, a knowledge of the correct parameters 
to select for the code and, even more important, enough of 
an understanding of the printout to determine if a global 
minimum haS been obtained and if not what changes might 
remedy the problem. A nonlinear programming code is a black 
Meme tequiring quality input in order to provide guality 
output. The most sophisticated code is of little value 


without a capable uSer. 


A practical evaluation of any nonlinear programming 
code must first examine the analyst-code interacticn, an 
interacticn loaded with frustrations. All codes reguire 
Subroutines provided by the user to evaluate the objective 
menmetion and constraint functions. Most codes also need 
first derivatives, and Some require second derivatives, in 
order to determine directions for improved solutions. The 
code has nce knowledge of the functions other than what is 
available £rem these subroutines. A general evaluation 
criterion is the relative ease with which the user can 
formulate these subroutines, especially the first time user. 
The code cannot operate without these function and gradient 
routines; the accuracy and correctness of these function 
evaluations determines the code's ability to interact with 


the user. 


There always exists the element of human error in 
coding these subroutines, errors which if undetected will 
result in inaccurate solutions. A code which leaves the 
user with no clue as to the type and location of such errors 
will cause delays in debugging. The total cost of reaching 


a soluticn-is not solely a function of the computer time 





used but is jointly dependent on the time of the man and 
machine. This author's experience indicates that, while an 
analyst does over a period of time develop an increased 
efficiency in using a code, for large difficult nonlinear 
problems the cost of the analyst's time will always bea 
Significant part and often will be the largest single 


Semponent of the total cost. 


This study is also a comparison of the codes, hopefully 
a guide to potential users as to which of the three 
nonlinear prcgramming codes might best satisfy a particular 
need, NumerouS nonlinear programming codes have been 
developed over the years without a Similar degree of 
interest being shown in testing and comparing their specific 
convergence abilities. The three codes chosen will be 
referred to as GRG, SUMT, and GRAVES. The GRAVES code was 
formulated in 1964 by Professor G. WwW. Graves and was 
Meriezed in March 1974 to obtain a solution to a sortie 
allocation nonlinear programming model prepared for the 
Department cf Defense Program Analysis and Evaluation. fhe 
GRG code, a Generalized Reduced Gradient Algorithm, was 
fewieotoped yeintly by L.S. Lasdon, A.D. Waren, 4.W. Ratner 
and A. Jain aS members of the Computer and Information 
Science Department, Cleveland State University and the 
Department of Operations Research, Case Western Reserve 
Pr versity. The SUMT code was developed by W. Charles 
Mylander, R.I. Holmes and G. P. McCormick as members of the 


Research Analysis Corporation, McLean, Virginia. 


This is the first computer comparison of these three 
particular codes. The GRAVES and GRG codes do not, at this 
time, have widespread usage and (before this study) have 
been primarily utilized by the authors and their close 
associates. For easier evaluation of the results the SUMT 
version 4 NLP code was chosen as the third and final code 


because of its more widely known qualities and limitations. 





This study was to compare the codes from the standpoint 
of a user with only limited knowledge of the internal 
operations of each. Although studies and tests performed by 
Someone thoroughly familar with the vagarities and intrinsic 
behavior of a code do reveal the upper bounds of a code's 
Capabilities, it was desired to test the accuracy and _ ease 
of utilization when each code was used by an analyst ina 
normal production atmosphere. If the input routines and 
tuning tclerances were originated by a user other than each 


code's author would they continue to perform satisfactorily? 


The codes were compared on the ease of preparaticn for 
the first time user and on their response to an analyst's 
effort to interact with the internal operations of the code. 
After developing a feel for the weaker characteristics of a 
code are alterations and improvements possible? The 
generality cf large production codes 1S such that an 
innocent alteration in one area of the code may cause 
ccmplete disruption elsewhere. Perhaps all-purpose codes 
are not really desirable for an analyst who over a period of 
years may wish to alter an algorithm to suit his specific 
needs, These three codes have very different approaches to 
the need for interaction between the code and the user and 
1n comparing the user-code communication for each of the 
three codes one must keep in mind the fact that the needs 
mmdee talents Of each analyst vary as-will the code best 


ewrted to these needs. 


These routines are coded in the same programming 
language (FORTRAN) and run on the same machine, the IB 
360/67. This eliminated the necessity of attempting to 
compare run times from two or more different machines. The 
IBM 360/67 1s a multiprogramming machine; there may be a 
variation in run times of identical jobs of as much as 25% 


depending on the loading of other work on the macnine at the 


10 





time of execution. There is no effective way to deal with 
this problen. All the codeS were run under the same 


Gonpaitions. 


The best known study to date 1S a paper (Ref. 1] 
Meesented Dy Colville in 1967, comparing 28 different codes 
which were grouped according to BOG general 


classifications: 
1. Direct search nethods 
2- Small step gradient methods 
3. Large step gradient methods 
4. Second derivative methods 


Colville chose eight problems from among a large 
Selection made available to him by the participants. Bach 
participant was then asked to solve this set of eight 
problems uSing his own NLP code and the computer facility of 
his choice. The results of Colville's study revealed many 
difficulties, inaccuracies and discrepancies inherent in any 
cooperative effort of this size. Of course, the time and 
effort required for one person to program and test 28 NLP 
codes would be prohibitive. Colville concluded that the 
efficiency and performance of a nonlinear programming code 
can be greatly affected by the method and efficiency of 
implementaticn on a computer. Several codes utilizing 
identical mathematical approaches had a large variance in 
accuracy and time. Algorithms which were identical from the 
theoretical viewpoint were not at all comparable in 
reliability, accuracy and efficiency because of considerable 
differences in the method of programming these algorithms 


for a computer. 
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In attempting to standardize the solution times fron 
different computers Colville developed a FORTRAN standard 
timing program which Simply inverts a 40 x 4O matrix ten 
times. However, the comparison of Standardized times is not 
a precise measure and the Colville study revealed quite a 
discrepancy ketween the standardized times of different 
computers when uSing the same programming code to solve 


identical problems. 


In any comparative analysis it is first necessary to 
develop a measure of effectiveness. The criteria necessary 
for evaluating a nonlinear programming code are complex and 
there exists no one formula which accurately weighs the 
various advantages and disadvantages of each code. For 
instance, the number of function evaluations is the total 
number of times it is necessary to evaluate the objective 
and constraint functions, in addition to any first and 
second derivative evaluations, before reaching the final 
solution of the problem. Although some studies have used 
the number of function evaluations required to reach the 
optimal solution aS a meaSure of the code's efficiency, this 
1S not a very useful criterion for constrained problems. 
The time required to determine the next point for function 
evaluation will vary greatly among codes. Thus, the time 
allotted for function evaluations may be quite insignificant 
Meeoeive tO the totai solution time and the scalar used to 
denote the number of function evaluations is really not a 
Fair factor for comparing the efficiency of different 
nonlinear programming codes. On the other hand, actual 
computer ccmputation time seemed to be the soundest and 
Simplest measure of efficiency of the codes. However, the 
guality of solutions can be aS important as their cost in 


terms of computaticn time. 


fe Comparison Criteria 
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The comparison of the three codes will be based on the 


melilowing criteria. 
1 Accuracy of the final solutions 


In evaluating general purpose codes a primary 
criterion must be whether or not the algorithm can solve the 


problems presented to an acceptable degree of precision. 


es Robustness of a code 


Although any solution which Ilccates a local 
minimum must be considered somewhat successful, a code which 
repeatedly attains global minima from both feasible and 


nenreasible initial points is certainly more desirable. 


Bh Speed of solution 


Total solution time is a function of the degree of 
precision desired in the values of the objective functions, 
the independent variables and the constraints. Because the 
degree of accuracy depends on the termination criteria 
employed to stop the computation, an attempt was made in 
this study to vary the termination parameters so that each 
code attained similar degrees of accuracy in all functions. 
MmbemeprOCccdure Was not always successful for each different 
test problem because of the variety of termination criteria 
- for each of the codes. The stopping criterion may be a 
function of the numerical components of the gradient, 
complete Kuhn-Tucker satisfaction, or a minimun absolute 
change may be required in the objective function between 
iterations. A steep slope or a relatively flat minimum can 
cause each code to attain a different level of precision 
even though the actual uSer supplied tolerances may be 


identical. 
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Not all codes are designed to obtain the same degree of 
precision. A fast, good solution may be needed or a 
solution with extreme accuracy may be desired. The code's 
design determines the ability to react to these different 
precision requirements and requiring precision beyond 
reasonable limits will completely distort time comparisons 
between codes. Thus, in order to achieve comparable times 
for each code in terms of accuracy, parameters were altered 
after successful solutions had been attained until Similar 


but not identical degrees of accuracy were attained. 


Perhaps the most accurate timing comparison between the 
codes would be net computation time reguired for each 
problem since net time does not include the time for 
procesSing read and write statements and delays caused by 
other unrelated machine activity. However, these additional 
times do affect the actual turnaround time, an important 
factor for any analyst working against a deadline. AS the 
Study progressed it was discovered that the solution tines 
were typically significantiy different for most problems and 
therefore total CPU time was chosen aS an adeguate criterion 


mor the ccmparison data. 


4. Ease of setting up the user supplied subroutines 
for the evaluation of the objective function and tne 


@emstraint equations 


In order to utilize any nonlinear programming code 
it is necessary for the user to supply one or nore 
subroutines. Every code requires a routine for evaluating 
the objective and constraint functions and many require the 
farst derivatives, while a few even need the second 
derivatives. The physical size and degree of difficulty of 
the setup subroutines that must be prepared for code 
utilization are two very important factors. Pee ereul< and 


lengthy codes are very vulnerable to° human error. fhe 


V4 





coding and debugging of first and second analytical 
derivatives (especially problems without very sparce, or 
recurring special structure in the constraints such as block 
diagonal, angular, staircase, or other form) can be a trying 
procedure. A Significant factor is the value of the user's 
preparation time. In some Circumstances a less efficient 
algorithm that can be easily coded for use is more practical 
than ah efficient code requiring many man hours for setup. 
A comparison along these lines is highly subjective and will 
memeye £rOM Situation to Situation but the relative degree of 
difficulty involved in uSing each code must certainly be 


@onsidaered. 


o. Output available to aid in debugging new programs 


Improperly coded functions and derivatives are 
bound to occur for almost every problen. yi ee Oe 8 OOP on Oe 
meld COde to provide appropriate output to aid in locating 
the particular mis-coded equations which are preventing the 
attainment of the solution. Most nonlinear programming 
codes do have the capability of providing output designed 
for checking for consistency between the function and 


gradient evaluations. 
6. Computer memory region required 

At most computer centers main memory requirements 
largely determine the priority of job requests and as such 
codes reyuiring large amounts of core will have much longer 
turnaround tines. Also many commercial data centers charge 
for computer service on a kilobyte-second basis’ making 
region equally important with time of computation. 


13 Failure mode 


All codes fail at Some time or another, usually 
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for one of two reasons: either they are not suited for the 
particular type of problem involved and a solution can not 
be reached, cr one of the user supplied parameters or 
perhaps even the initial starting point needs to be altered. 
Some codes fail "hard" and the user cannot determine the 
cause from the available output while others fail "soft" 
With pinpoint details as to the last available point, 
function and gradient values and, in the case of a binding 
tolerance, the particular parameter that needs to be 
altered. Quick and accurate determination of the cause of 
failure can save an analyst many trial and error computer 
runs. This is especially valuabie in the case of long 


mmenaLround times. 


S Growth possibilities 


Contemporary nonlinear problems of 100 variables 
or less are really smali or moderate sized and the prospect 
of expanding a code for hundreds and even thousands of 
variables 1s considered. The growth in code and CPU time is 
certainly not linear and a code'ts baSic structure may 


severely curtail its feasibility for expansion. 


i. Test Problems 


For this study eight problems were selected 
encompaSSing various degrees of difficulty. The number of 
variables and ccnsStraintsS range from 9 to 100 and 2 to 20 
respectively. Most of the problems contain combinations of 
linear, necnlinear, equality and inequality constraints. S$1x 
of the preblems have been previously published with the best 


Known soluticns. 
In testing any nonlinear programming code a prior 


knewledge of the global minimum is certainly helpful in 


evaluating the precision of the code. The last two problems 
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were expansions of models with fewer variables and each code 
was tested against the smaller problem with only changes in 
tne initial parameters necessary for the actual test 


problems. 


All three codes are sensitive to problem scaling, 
[mererore, cro problems with Significant (or contrived) 
Magnitudes of difference between the independent variables 
were utilized. Initially it was intended to test the codes 
with hundreds of variables but this probiem dimensionality 
Was not achieved because of computer memory and time 
limitations. One problem, developed by the U.S. Army 
Concepts Analysis Agency, consisting of 500 variables and 45 
constraints was dropped because, although the Graves code 
could solve it using 200K bytes of main memory, the SUMT and 


GRG codes would reguire well over 1500K. 


17 





or Doon ee TEON OF CODES 


a ee i ee we ee =~ or: —— <> aka ay a 


A. SUNT 


The SUMT computer code was developed by the Research 
Analysis Corporation in the 1960's and improved throughout 
the decade. SUMT implements the Sequential Unconstrained 
Minimization Tecnnigue for nonlinear programming and other 
computation techniques developed in Chapter 8 of the book by 
Mmeacco and McCormick {Ref. 2]. SUNT is coded in FORTRAN iV 
and employs double precision arithmetic. The mixed 
interior-exterior penalty function is used and _ several 
options are availabie for minimizing the penalty function. 
Specifically the SUMT code addresses the question of 


locating the N dimensional vector x(¢) that solves 


minimize f (x) 


WZ Greve eg ll 


subject to Se) 20; 2) 
J 


I 
om) 
« 
3 
H 


h_ (xX) ae (6 6 genius 
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The SUNT algorithm has been developed to solve the 
nonlinear programming problem in which the objective 
function and the inequality constraints can be nonlinear 
functions of the variables but in order to guarantee 
convergence the equality constraints should be linear 
functions of the independent variables. However, very 
accurate SUMT solutions have been obtained in many prcblems 


With nonlinear eguality constraints. 


The SUMT approach is to solve repetitively a sequence 


of unconstrained problems whose solutions in the limit 


18 





approach the mMininus OF the constrained nonlinear 
programming problem. To convert problems the SUMT code uses 


the penalty function 
p 


m 
k k 1 \ Z k k kK 
pe 2) = ec) + —{(k) | ne (x) ae in g, x‘) 


1=1 1=m+1 


Where the factors r are positive and decreasing as the 
Minimization progresses. As xr is reduced, the barrier 
effect 1s reduced and x(e) may move closer to an inequality 
constraint bcundary. For the equality constraints the sun 
of squares is used, thus, aS r approaches zero the equality 
constraints are closely satisfied. If an initial feasible 
point 1S not provided by the user, repeated application of 
the SUNT methcd is used to obtain an x(¢) vector that iS an 
interior feasible point. However, in the case of highly 
nonlinear constraints a great deal of time may be used to 
initially lccate a feasible point. When available the user 


Should previde a feasible starting point. 
Utilizing the first feasible point and the initial r 
1 
value provided py the uSer = is determined by minimizing 
(0) (0) (1) ae 
Pix me : Then 1s computed and utilized to 
(2) 


1 1 
determine x by minimizing p {x ‘ ! y and so forth until 


a Minimum is obtained. Although three possible settings are 


(0 
available, r yy 1s the most practical. Computation time 
ae (0) 
Becomes ionger for larger initial values for rc = Loo 
Marge an initial r- distorts the initial P function and 


forces x(e) too far into the feasible interior while too 


(9) 


Small ae or starts x(*) too close to the boundary. 


ino 





0 
Overall, ~ = is a good penalty setting. 


iierdit rection of Search for locating a new minimun of 
the P function is obtained by Newton's Method. This 
requires multiplying the inverse of the Hessian matrix by 
mae, gradient of the P function, Not only is the time 
element quite high but the inverse of the Hessian matrix can 
become ill-conditioned. Thus as the extremum is approached 
the search directions may become misleading necessitating 
additional time for the code to backtrack in search of 
another reasible direction. Once the search direction is 
established, SUNT uses a Fibonacci search to locate the 


Minimum of the P function. 


1. Docunentation 

The necessary steps for SUNT operation are clearly 
and thoroughly presented for the first time user. Reference 
3 by Mylander, Holmes and McCormick greatly facilitates the 
use of the SUNT code by the unfamilar programmer. This 
document corcisely presents a brief summary OF the 
theoretical background for the algorithn implemented by 
SUMT. The step by step logic of the computer routine is 
deveioped and accompanied by a flowchart of the minimization 
process. Reference 3 continues with a general description 
of the computer program listing and discusses the SUMT 
internal subroutines. The program is modular in structure 
to allow for easy changeS in options, input, output and 
tolerances for determining when the optimum solution has 
been obtained. A table is included which details the 


Lelationship between the subroutines with inter-routine 


communications being handled by labelled COMMON regions. 


One or more paragraphs are allotted to each subrcutine 


indicating its function and general logic. 
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A separate chapter discusses the uSeL Supplied 
Subroutines. A complete and detailed description of the 
necesSary common regions for parameter passing between the 
SUMT Main minimization program and the uSer routines is 
supplied, along with the input and output reguirements of 


the four subroutines. 


The parameter cards and their necessary formats are 
covered inciuding a complete description of the available 
options and a recommended setting for each of the tolerance 
parameters. Three dimensional figures are included showing 


mites data deck Structure necessary for the SUMT code setup. 


Finally the the document presents a complete problen 
Zornulation and solution. Starting with the a iaetena le 
eguations, illustrations are provided which display the 
exact input deck setup and the actual computer output with 


Tinal and intermediate solutions. 


2. Lwplementation 
To implement SUMT the user must Supply four 
SlerOutines: READIN, RESTNT, GRAD! and MATRIX. 


ae READIN 


READIN is called only once and allows the 
user to read in the coefficients necessary for objective and 
constraint function evaluation. . This routine was utilized 
Mae thas Study to inhitialize an array which tabulated the 
number of calls to each user supplied subroutine. Of 
course, any initial printout desired by the user can he 
handled in READIN also. 


b. RESTNT (I,VAL) 
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Pie w0e eREotNT returns VAL = £(x). EOE 


i #0, VAL = g (x). The current x(°) values are found in 
i ; 


the common region. 


CC EAD tae 2} 


When I = 0, GRAD1 must place the gradient of 
the objective function £(x) in the array DEL(*). When 
feo, DEL(Ce) must contain the gradient of the constraint 


@omnesponding to I. 


The SUMT main program contains a subroutine DIFF1 which 
evaluates the gradient by a numerical differencing routine. 
DIFF1 can be called by GRAD1 if explicit derivatives are not 


possible or feasible to compute. 
dz MATRIX (J,L) 


This routine places the Hessian of the Jth 
equation in aN x N array where N equals the number of 
variables in the x{e) vector. SUMT also provides a 
Subroutine DIFF2 which can be used to evaluate the Hessian 


by numerical differencing. 


For data input the user muSt supply a parameter card, 
two option cards, a tolerance card and cards containing aa 
initial x(e) vector. The format for these cards are _ preset 
am 6 6SUMT. The two most critical parameters are EPSI and 
THETAO. These two tolerances determine, respectively, when 
an unconstrained minimum has been achieved for _ each 
Subproblem and if the solution to the NLP problem has been 


Poewoxwiliated. The trivial constraint that all x. 2 0 can be 
il 


Set automatically by the option cards and extrapolation 


through the last two or three minima can be utilized if 


Paps 





desired. Any coefficients necessary hor function 


evaluations must be input here also. 


3. Printout 

Sunt provides a listing of all input parameters, 
initial x(e) vector values, initial objective function value 
and the values of the initial constraint functions. The 
output is controlled by an option card parameter and can be 
set at two levels, either providing printout after the 
solution cf every subproblem or after every intermediate 
pornt. Final and intermediate x({e) vector values are 
provided along with the minimized objective PUN Ce rem. 


Lagrange multipliers are printed along with "first-" and 


"second-order solution estinates." These multipliers and 
"order" estimates are printed out after each mininum is 
obtained. These estimates [Ref. 2] are obtained by 


extrapolating through two and three minima to explore the 
Meagectcry of these points. This trajectory accelerates 
algorithm convergence and provides a close approximation of 
the local or global minimum early in the minimization 


progress. 


4. Debugging Aids 


Any subroutine reguiring the evaluation of as many 
as 100-variable functions and complicated first and second 
derivatives is very susceptible to bhaaad=to-detece 
programming errors. SUMT contains a Subroutine cailed 
i[e@eeCkKER Which provides a listing of all first .and- second 
derivatives cbtained by the analytical methods of GRAD? and 
MATRIX. A printout then immediately follows containing the 
Same derivatives computed by the numerical differencing 
Subroutines DIFF1 and DIFF2. Any large discrepancy between 
the evaluation techniques would indicate which subroutines 


and equations should be double checked. 
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5- Alterations 
Two of SUMNT*'s internal subroutines DIFF1 and 
DIFF2 were altered slightly for this study. Originally the 


value used for the differencing was a small positive user 


—~ 3 -4 
Supplied value of approximately 10 Of 10 °eeeeinis Constant 


value proved inefficient in problems with a large range in 
the magnitude of the independent variables. Four FORTRAN 


statements were changed in DIFF1 and DIFF2 so that the value 


4 
used for differencing was equal to 10 x (the absolute 


~ 4 


value of the variable x (¢)) Of SIO Soo whichever larger. 
a 


This change proved more efficient in Problems 5 and @ and in 


comparing the analytical and numerical derivatives in the 
M@reCKER subroutine. 


B. GRG 


The GRG code was developed jointly at Cleveland State 
University and Case Western Reserve University by L.S. 
Lasaon, A.D. Waren, M.W. Ratner and A. Jain. GRG uses the 
Generalized Reduced Gradient Algorithm to locate the vector 


X(¢) which sclves 


rinimnize gq (x) 
M+1 

Subject to g (x) = 0, este ss a gat ne 
Sa 
Os = NOt 1 yee ty 


g (x) S$ UB(N+i), i 
1 


Pee ex aS UB, ie Ul tera, N 
J. ° 


24 





The fince .cens g are assumed to be continuously 


differentiable. 


The generalized reduced gradient algorithm uses a 
modified gradient to solve nonlinear objective functions and 
nonlinear ecnstraints. By using linear or linearized 
constraints the method defines new variables that are nermal 
to some of the constraints and transforms the gradient to 
the new basis. The code operates in two phases, first 
finding an initial feasible point, and second minimizing the 


user supplied objective g eos Of course, time is saved 
Mt 
1f the user supplied starting point is feasible. If the 


starting foint is nonfeasible tne GRG code will locate a 
feasible point by minimizing a phase I objective function, 


which is the sum of the constraint violations. 


Once a feasible point is obtained the algorithm 
determines which constraints are binding for the current 
moe vector. A constraint is binding if it 1s within EPNEWT 
of its upper or lower ranges. EPNEWT is a small positive 


rs 
number supplied by the user with a default value of 10 . 


GRG solves for K of the natural variables, where K is the 


number of binding constraints at that time. These are basic 
variables and are solved in terms of the remaining natural 
variables. The binding constraints may then he solved by 
using the reduced gradient to determine a search direction d 
which is employed in a series of one dimensional searches 


whose goal is 
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Minimize £(x(e) + dd) 


A>0 


To guarantee that the direction d is always a direction of 


descent 
4h 
GaayE(xy. <, 0 


Mise hold. A variant of Newton's Method is used and if 
convergence iS attained and no constraints are violated a 
new AQ value is selected and the one dimensional search 


process continues. 


Once a solution is found the constraintS are checked 
OL violations. Then the current objective value is 
ccmpared to the previous best value and the best values for 
the variables, constraints, objective function and stepsize 
are stored. If the Newton Method has not converged the 
stepsize is cut back until no improvement is noted in the 
SelmstraintsSs for ten iterations or until the maximum 


constraint violation is less than EPNEWT. 


Newton's Method is used to compute the values of the 
basic variables for given values of the nonbaSic variables 
and then the search direction is determined by using the 
inverse cf the basis matrix. This requires two J x J 
Matrices where J equals the number of binding constraints. 
In large fproblens the main high speed computer memory 
required for the storage and inversion of these matrices 


becomes a majcr issue. 
For the initial estimates of the basic variables the 


user may select gquadratic extrapolation or a tangent vector 


is computed. Miron out ommaegelerate a separate 
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Subroutine is used to compute the search direction uSing the 
tangent wector to construct a feasible direction. The 
(NXN)/2 metrix required for this basis is another array 


contributing to the hich memory requirements of GRG. 


irom Usiidio stOpping Criteria is satisfaction cf the 


imimm-Tucker conditions to within EPSTOP, a user supplied 


Ee 
tolerance level with a default value of 10 - The code also 


employs aS stopping criteria limits for the total number of 
iterations and number of Newton iterations without 
convergence, or if the relative change in the objective 
fine t Lon 1s less than EPSTOP for three consecutive 


iterations tke present solution is considered to be a 


Mininun. 
1. Documentation 
The GRG code is documented by two technical 
memoranda published in November, 1975< "'GRG Systen 


Documentation" [ Ref. 4] and "GRG User's Guide" [Ref. 5] both 
authored by Lasdon, Waren, Ratner and Jain. Reference 4 
briefly describes the version of the Generalized Reduced 
Gradient Algorithm that is being utilized by the GRG code. 
A short overview of the entire code is given followed by 
Beobes listing all the Subroutines With a concise 
descripticn of each routine's function and its relaticn to 
each of the cther routines. GRG is coded in FORTRAN IV and 
uses double precision amit ime: ie. Inter-routine 
communication is handled by labeled COMMON regions. Several 
flowcharts are included which detail the use and derivation 
of variakles and the utilization of parameters and 
tolerances to influence the logic of the GRG_ code. 
Reference 5 provides the first time user with explicit 
instructions as to the mandatory and optional subroutines 


which are provided with their necessary input and output. A 
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Bomplete description of the data cards and the options 
available for each of the input parameters is given along 
With several suggestions for possible alterations of the GRG 
main program and subroutines in order to revise data and 
omc put. An example problem is given. Beginning with the 
objective and constraint equations a step by step solution 
1S given including the actual user supplied subroutines and 
@ata cards. Actual computer output is also reproduced. 


oS ae ee est eS 


2. ITnuplementation 
2 Upsement 


To implement GRG the user must Supply one 
Mandatory subroutine, GCOMP. Two additional routines, PARSH 
and SUM&RY, may be provided if the user _ so desires. 


Arguments for all subroutines are double precision. 
a CEONP MG, x) 


GCOMP computes the constraint functions and 
the objective function at the x(e) vector which contains the 
N variabies at their present values. The array G(*) then 
returns these values from GCOMP to the internal subroutines. 
No COMMON area 1S necessary although it is available if the 
user needs additional variable values for the computations. 


Any coefficients may be supplied by data cards. 
b. PARSH (X,G,i4,N,GRAD) 


PARSH computes the gradients for each of the 
constraints and the objective function and returns’ these 
values to the main program in the (M + 1) x N array GRAD(e). 
Any coefficients needed for derivative computations can be 
held in COMMON with GCOMP. If analytical derivatives are 
not highly nonlinear or are extremely expensive to evaluate 
GRG contains a PARSH routine of its own which uses forward 


numerical differencing to establish the derivatives. 
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C. SUT Yel, XxX, GC) 


This subroutine is available if the user 
desires any additional calculations and printing after GRG 
has arrived at a final solution. For any data in addition 
to the argument list COMMON blocks can be used. For 
example, the Lagrange aultipliers are available for 


checking. 


Using format statements which are preset by GRG the 
user must supply about ten cards containing parameters and 
tolerances for determining when final convergence has’ been 
obtained. In addition initial values for the x(¢) vector 
must be supplied and any variables having finite upper and 


lower bounds must be listed on separate cards. 


GRG initially prints out a summary of all initial 
parameters, tolerances and initial x(e) vector values along 
With their upper and lower bounds. Several levels of output 
are available. It is possible to receive, in very readarle 
form, the objective function value, constraint function 
values, x(e) vector values, gradient vectors and other 
computatignal aids such as stepsize and explicitly viclated 
constraints. These values can be requested after each 
Mmeerzation Or only arter the final solution. Mey Msi 
printout delivers final values, binding constraints and 


number of calls for function and gradient evaluations. 


4. Debugging Aids 


In much the manner of SUMT, GRG provides a means 


of checking derivatives by two methods. These aids of 


, course won't catch every programming error but they do help 
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<i» determining if the problem is in the function evaluation 
wotie egrmaients. To check GRG gradients it is necessary to 


2 £2er the wutput level and run the problem twice, first with 


Meethe user*’s PARSH routine with analytical derivatives and 


again with the PARSH that iS an internal subroutine and 
delivers derivatives by use of numerical differencing. GRG 
then prints out the initial gradient values for all 
equations and stops without attempting to solve the problem 
until the user is satisfied the gradient and function 


evaluation sukroutines are consistent. 


er. GRAVES 


The GRAVES code was developed by G. wW. Graves of 
U.C.L.A. and has been used over a period of twelve years to 
solve a wide variety of real world problems. The GRAVES 


nonlinear program is a linear approximation algorithm cf tne 


feasible direction class. GRAVES specifically solves the 
problen: 
maior vr 
minimize arate 
g Yur ‘Vn3 
1 
subject to g VOSS ieee) = 0, ee Ae eve 
AL 
g BUG 8B < O, 1 = Tie tighten ere 
with 
LB Ss y. S$ UB a—ieaies 7 NS 
1 a 1 
i. e 
g (y) (=F 1l7... 0) Must be continuously 
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Ci cemenclagte functions. 


fhe GRAVES code solves general nonlinear programs by 
solving a sequence of local linear problems which in the 
limit converge to a local stationary point. The local 
linear Stationary points are global or local minima, or 
saddlepoints if the original nonlinear system is feasible. 
Memever, the test of practicality of an algorithm is not the 
existence of convergence but the speed with which a solution 
is obtained. This algorithm has been developed over the 
years and has evolved in response to actual problems. The 
code has performed well when used by its developer and 
analysts familiar with the extensive interior features, 


options and tuning mechanisms. 


Linear programming is applied repeatedly to the 
linearized nonlinear problem in Such a way that the 
solutions to the linear sSubproblems can converge to the 
sclution of the nonlinear problem. Linear approximations of 
nonlinear functions are obtained by using first order Taylor 
serieS approximations expanded at y(¢) to replace the 
nonlinear functions in the original problem. The code has 
been termed a “jocal," "gradient," "stepwise" correction 


descent algorithm because of the method of selection of new 


0 
points in the minimization process. Given a point y_ the 


0 
next "step" is y= y + kAy where the step length is 


determined by the scalar k which is based on the behavior of 


O 
the system in the neighborhood of the current point y . The 


step direction is determined by the gradients of the 


i 
Pier rons ¢ (y) (1=1;...,M=-1). The direction of improvement 
is obtained by estimating the remainder term in the Taylor 


0 
serieS approximation to g(y +Ay) and solving the 


31 





associated local linear programming problem. The remainder 
terms make the local linear approximations more sensitive to 
the behavior of the approximated functions because they are 


measures of the magnitude of local nonlinearity [Ref. 6}. 
The generic local linear programming problem is: 


Sumegect tc the constraints 


n @ io a 
Vig =a (y ) -— KI lectern | 


m O 
choose y to finimize vg (y )Ay. 


af 
The gr are constants used in place of the Taylor series 


remainders (for convenience these are estimated from 
function behavior over the most recent step) and are equal 
to zero for strictly linear functions. The k is used to 
parametrically adjust the solutions of the local linear 
problems; as k decreases, improvement in feasibility becomes 
eCasier but the gain in the nonlinear problem decreases. 
This scaling parateter is also used to insure that once a 
feasible point has been located each successive point is 


also feasible. 


After solving each local linear program and calculating 
the Taylor series remainders an interval determinaticn is 
used on each constraint to determine a feasible movement 
interval. Each constraint is replaced by a guadratic Taylor 
approximation for determining the interval of feasibility 
along the Ay solution of the local linear progran. ige 
feasibility is impossible alongAy within the approximation 
range of the functions, the interval is modified to that 
corresponding to 1/2 the current solution infeasibility, 
then 3/4 the current infeasibility then 7/78 etc. until 4 


a2 





nonempty interval is found. The minimum of the objective 


function over this interval is then eStimated by one of the 


Opeitonal ray 


search mechanisms, a new solution is obtained 


and another local linear program is begun. 


The solution of a particular nonlinear problem requires 


the user to specify (or use the default values for) several 


Of the algorithm's parameters including: 


ZL 


ZT 


fF 


x1 


10.4 


IPC, IEN 


TC Gane 


NEGF 


a "zero level" for variables (used 
throughout the nonlinear and linear 


programming routines) 


a "zero tolerance" for functions 


M 
a "tolerance level" for G (y) used for 
termination of solutions by bounding 


the objective 


Gn Dea htDelorinty™ for dntermediate 


Output during solution 


a "problem type indicator" for problems 
With special structure 


{for instance, pure LP. ) 
permutation limits for variable classes in 
hybrid pricing schemes (for large 


scale problems) 


a nonlinear iteration limit between calls 


to the user control moduies 


pricing mechanism control (e.g. first 


negative, most negative, or candidate set 
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size for large scale problems) 


JM a cay search mode selector (e.g. quadratic 


fit, lattice/binary Search, etc.) 


RELAX a relaxation mechanism to allow weighted 
gains in the objective function for 


infeasible intermediate solutions 


roma a Kernel flush threshold for relaxation 
solutions (minimum explicit basis dimension 


in the local L.P. before gain check) 


EB the "eguation bandwidth" to permit 
movement of solution in the presence 


of nonlinear equality constraints. 


AR the “approximation range" over which 
functions will be expected to behave 
reasonably with respect to second order 


Taylor series approximation 


NP the "number of points" for the direct 


ray search lattice option 


ININ the "number of (binary) minimizations" 


for the direct ray séarch option 


My ons, N2 the problem dimensions 


Convergence for the algorithm may be rigorously proved 
{ Ref. 7 7 for the usual class of quadratic problens 
(necessary assumptions are required for all problems 
concerning Kuhn-Tucker regularity and bounded steps from the 
iocal linear programming problems). Although the algoritha 


is a first order descent method, second order problen 
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representations can be accomodated [Ref. 8]. The imkedded 
linear programming aigorithm has been described in Ref. 9; 
mers designed to facilitate primal and dual manipulation of 
the local linear programming problems, (especially basis 
changes brought about by parametric adjustment of the fright 
hand side via k) as well as to deal with degeneracy, local 


inconsistencies and locally unbounded solutions. 


The termination criterion for the code is a vector y! 


which sSatisties 


N i 
Seti = 9 {y) * © 


Where e 1S a Small user supplied value (TL). An e value 
Which is scaled to the magnitude of the objective function 


i | ; 

G iy‘) is very important to prevent unreasonable consumption 
of computer time when the gain in convergence is very small 
for each new solution. A maximum nonlinear iteration count 


(ICYCLE) is also used to interrupt progress. 


1. Documentation 


The GRAVES code has not peen released to the 
general public and presently little documentation exists 
that is devoted explicitly to detailed discussion of the 
algorithm. Reference 10, "Sortie Allocation by a Nonlinear 
Programming Model for Determining a Munitions 4ix", by R.Jd. 
Clasen, G.W. Graves, and J.Y. Lu is a report published by 
the Rand Corporation in 1974 for the Department of Defense 
to study the maximization of effectiveness of tactical 
sorties assigned to air-to-surface missions. The Rand study 
used a Piy1l version of the GRAVES method but a FORTRAN IV 
double precision version of slightly later vintage was 


utilized for this comparison. Chapters III and IV of the 
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Rand document are devoted to the theoretical background of 
this algorithm and the application of the programming code 
to the specific tactical air support problem. Appendices A 
and B present the alterations necessary to utilize the code 
for other nonlinear problems. A flowchart of the logic and 
the calculations performed by the code is presented along 
With a iisting cf the internal subroutines and variables. 
Variables which may or must be set by the user are denoted 
along With default values. Appendix cC describes an 
additional program called CONTEST which is available for 
checking the consistency of the user's subroutines. A 


Meorchart for the CONTEST program is included. 


2. Inmplenentation 
icles chnOte the GRAVES code must supply four 
BeriIRAN Subroutines; SETUP, FCNGEN, COLGEN and RESET. 


a. SETUP (INAM) 


SETUP 1s called only once at the start of 
Gach nonlinear solution attempt by the main GRAVES code. It 
does all of the data reading for the main code and provides 
the coefficients for function and derivative evaluation in 
other user supplied subroutines. SETUP shares CONHON blocks 
feen the GRAVES internal Subroutines. All variable input is 
done in the SETUP subroutine. All the values for all 
initial points and parameters must be input here; the user 
can call any outside FORTRAN program of his own for input of 
these values. Any data structure may be employed that will 
provide information for the following function generator 


Boutines. 


b. FCNGEN (JP) 
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FCNGEN is called to calculate only far (the 
@Srpagective function) if JP = 1. If JP = 0, then alls 
functions will be evaluated and stored in the array G(»). 
Gms) G(2),-.-,G{(i-!) are the values of the constraints and 


G(4) is the objective function value. 
CH COLGEN (JC) 


COLGEN computes the gradient of the variable 
JC for each constraint and the objective function. On call 
the procedure must place the JCth column of the gradient in 
Memmi, 8 CA(2),-<«-,CA(M). The method of determining the 
derivative may be analytical or a numerical differencing 
routine. The value of the primal variables y(*) will not 
have changed since the last FCNGEN cail, thus the function 


valves from that call are still valid. 
d. RESET (LPC) 


ReSttiemismeGdlLbed  Oniy after the internal 
control routines have determined tha a termination 
condition exists. This allows the user to diagnose the 
nature of the termination, to print any additional output 
that he needs, or closely monitor and interact with the 
solution progress. The user maintains complete control of 
the code and it is possible to restart the soluticn, alter 
the initiai foint, change functions or tuning parameters, or 


even run a ccntinuing seguence of nonlinear problems. 


3. Printout 

The output level can be varied by use of a 
parameter in SETUP. The amount of output can be controlled 
from extremes of none to voluminous detail within the local 


Linear programming solutions. If not inhibited the GRAVES 
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code prints the initial parameter values and tolerance 
levels. Daieeeoucpice typically includes the ncenzero 
Variables, the final values for the objective and constraint 
functions as well as the Lagrange multipliers if the user 


desires. 
4. Debugging Aids 


GRAVES provides an additional main program named 
CONTEST (consisting of only about 100 FORTRAN statements) 
which can be used to debug the user's SETUP, COLGEN and 
FCNGEN routines for mathematical consistency and Ilcgical 
program compatability. The program, acting aS a surrogate 
nonlinear package, prints the derivatives for the variables 
and compares these to the results from differencing. 
Initial values for y(e) and evaluations of objective and 
eonstraint functions are also provided for checking. 
@enrhSt also checks for individual function linearity and 
convexity, properties of potential use to the analyst, and 
thus (after providing information for the debugging of the 
user subroutines and data) can also be utilized to gain an 
intuitive feel for the problen. CONTEST can provide the 
user With the appropriate zero and tolerance levels, 
approximate range for the Taylor series over the specified 
domains and an insight as to the degree of nonlinearity of 


eaen constraint . 
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The first step in the study was to obtain the three 
codes and documentation for each. The codes were 
permanently installed on a program library at the NPGS 
Computer Center and subsequently only the user subroutines 


and initial parameters were needed for each rproblen. 


Of the eight problems five were received on computer 
@eed>s £rom Professor Lasdon already encoded for GRG with the 
Optimal parameter settings already determined. This degree 
of professional tuning was not really desirable from an 
experimental point of view but the GRG solutions for the 
three remaining user coded problems were Similar in accuracy. 
and time so this bias was actually found to be minimal. A 
Sixth problem was selected from the Himmelblau coliection 
(Ref. 11] and the remaining two were adaptations cf an 
inventory model and an entropy model which were specifically 
designed to illustrate real world problems with faw 
constraints but many independent variables. The test 
problens selected were considered typical of the small to 
medium size problems being solved today. The structure and 
degree of difficulty among the eight are quite varied and 


represent a fair sample of available relevent probiems. 


No attempt was made to keep an accurate accounting of 
the man hours necessary for preparation of the problems for 
each code Since any analysis along these lines would be 
extremely biased because of the learning curve for each 
problem and the head start given in this respect to GRG. 
Once subroutines for evaluating the objective and constraint 
functions and the gradients had been coded for one of the 
nonlinear programs it was quite simple to adapt them to 
either of the other two codes. For most of the problems the 


GRAVES code was utilized for the initial programming because 
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of its superior turnaround time which 1s made possible by 
its very low memory requirements. Turnaround time may be of 
small importance for comparing the results of several 
different initial starting vectors or termination parameters 
but for the initial coding and debugging phase quick 
turnaround is highly desirable. In addition the GRAVES code 
has the special routine CONTEST, which is a main  progran 
rather than a subroutine, for checking the feasibility and 
consistency of the function and gradient subroutines without 
utilizing the main nonlinear package. Although SUMT and GRG 
have accurate and easy to use procedures for checking the 
consistency of ie gradient and function evaluation 
Subroutines they both redquire utilization of the main 
nonlinear codes with their high core and corresponding time 


requirements. 


Himmelblau estimated preparation times for a typical 
problem and experienced user of from one to six hours for 
porn GRG and SUNT [Ref. 11 pg. 381]. SUMT preparation times 
for unfamiiiar users were considered to be two to five tines 
ase great. These figures are based on problems with less 
than 50 variables and are in keeping with this author's 
experience. Occasionally coding errors arose which reguired 
literally days to debug but these were oversights of the 
user and did not appear to be inherent to any one particular 


code. 


The SUMT code required a third computational subroutine 
to evaluate the Hessian matrix and this subroutine required 
on the average a great deal more time than the gradient and 
function subroutines. For extremely nonlinear problems the 
calculation, coding and debugging of second derivatives was 


tedious and there were many opportunities for errors. 


The GRG and GRAVES code require comparable preparation 


time for ‘the computation subroutines although parameter 
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Berting and alteration for the GRAVES code was considerably 
quicker and easier. All tolerances and initial values could 
be input in the GRAVES subroutine SETUP through the use of 
individual cards or Do Loops. The GRG code reguires a 
complete listing in a pre-set format of all initial x(») 
values as well aS any upper and lower variable bounds that 
need to be provided. The format for these bounds allows 
only one bound per card thus entailing 200 separate cards 
for a hundred variable problen. Both SUMT and GRG use 
parameter and option cards which are difficult to initiate, 
alter and comprehend. With the exception of the two or 
three parameters which were consistently altered for each 
problem it wWaS necessary to carefully consult the user's 
Manual in order to change any of the tolerances for tuning a 
final solution, The GRG default values worked guite well 
for most of the test problems (which may be due to the 
fmmmeng = perrormed by the originators) but when the need for 


alteration arose the manual was a necessity. 


The documentation for both the SUNT and GRG codes was 
excellent. Instructions for initial deck arrangements and 
the parameters required along with the recommended values 
for the toierances were clear and sufficient. The GRAVES 
code is not presently a publicly distributed package and as 
such the documentation iS not comparable to SUMT and GRG in 
Megard> ‘tO the proper tolerances and parameters to be 


mepl3zed. 


The SUMT and GRG codes are production type codes which 
are intended to solve a variety of problems without the user 
attempting to make any significant changes in the logic and 
methods of the codes. The GRAVES code 1S intended to be a 
production code of a personalized nature which requires that 
the analyst be aware of the internal logic and be able to 
interact with the code. Although the code has been steadily 


expanded over the years to solve a constantly enlarged list 
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of real world problems (in fact, other versions have been 
produced for nonlinear integer GUB problems) the alterations 
have been enacted to solve specific problems without 
Steerctent attention given to the global effect on all 


problems in a given class. 


Although not planned as part of the original study, 
Professor Graves was contacted and did provide recommended 
parameter settings for several of the problems based on a 
description of the performance of his’ package on early 
mimals. These suggestions measurably increased the 


efficiency of the code. 


After successful solutions were obtained for all the 
codes, parameters and tolerances were adjusted in the codes 
mimonrder tO Obtain comparable objective function values and 
constraint tolerances. In most cases the GRG solutions were 
allowed to stand and the SUMT and GRAVES codes’ were 
adjusted. This procedure was adopted because of the prior 
tuning of the GRG probiems. In most instances the GRAVES 
code did not achieve the same level of accuracy as GRG while 
SUMT tended in some cases to compute for several iterations 
without showing a Significant increase in solution accuracy. 
By terminating SUMT at the accuracy level of GRG, CPU time 


in excess of 15% was saved in some problems. 


Once comparable levels of precision had been attained 
two new initial vectors were selected for each problem and 
the algorithms were run again. The objective function 
values and solution times for all three initial points are 
listed in Table III-1. 
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Solutions and times fren three 
Mi ttactArting polnts 


fable III-1. 


Test BOureatiomecul On an LBM 360/67 using FORTRAN H compile 
for main code and FORTRAN G compile for the user subroutines. 
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Problen 7 
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initial points for alternate solutions 
are listed with respective probilen 


description in Appendix A. 
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|]oe18 siresb rey ve computer coding of the user supplied 
Subroutines will be a very important consideration in the 
amount of CPU time a particular algorithm requires and an 
attempt was rade to determine which code 1s most dependent 
on the programming capabilities of the user. The GRG code 
records and prints as part of the final output the number of 
calls that were made for function and gradient evaluations. 
Similar counters were inSerted in SUMT and GRAVES and the 


totai calls for each are presented in Table III~2. 


Obvicusiy because Oe the inherently different 
approaches taken for gradient evaluations by the codes these 
numbers alone do not represent an accurate picture of the 
importance of the user supplied subroutines. While SUMT 
Gattis for the gradient of one constraint at a time and 
GRAVES evaluates the gradient of one variable at a time 
relative to all the constraints, GRG evaluates aoe 
constraints in one cail necessitating a N x N matrix and 
thus showing only one gradient call for each N calls made by 
SUMT and GRAVES. In addition SUMT requires a HesSian 
routine while GRAVES and GRG have no comparable evaluation 


requirement. 
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Table III<-2. “peoutine calls for each code 


Problen SUL. GRG GRAVES 
a b 

F 15929 Zod 26 
1 G 1479 54 2609 

H 1479 

F Zins 2 172 Oa ee 
2 G 1.5.6 13 86 81 

H 156 

F 4u98B2 546 964 
3 G “14 35 39407 

H G14 

F 9151 204 520 
4 G 656 18 . 1425 

H 656 

F Lt > Ss: B05 
5 G 92127 # S)) 1851 

H 3234 

F 3193 375 G“ug 
6 G 310 69 52397 

H 310 

F 3447 1605 09 
7 G 147 76 30719 

H BY 

F 565 MP2s Os 
8 G 1320 # (3 63144 

H 28 


fecunetion calls G~gradient cails dH-hessian calls . 
#—numerical differencing was used for some constraints 
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Notes for Table III-2. 


meeeenh SUMT function cali and gradient call required 
evaluating only one of the M constraints. Thus, M+ 
Subroutine calls are needed to obtain the same results as 


one GRG subrcutine call. 


b-Each GRG function and gradient call vrequired evaluating 


all M constraints and the objective function. 


c-~Each GRAVES function call reguires either ali constraints 
and the objective function or the objective functicn alone. 
Each gradient call evaluates the gradient column for all 
constraints and the objective function associated with one 
@emetnc N Variables, thus N gradient calls are required to 


obtain the same results as one GRG gradient call. 


Hm Order to present anh accurate evaluation of the 
itportance of the user's efficiency in programming whiie 
avoiding any misguided attempt te standardize the number of 
function and gradient calis for the different codes each 
probiem was re-run a Second time using an added Do Loop in 
€ach user subroutine. This loop required the evaluation of 
each subroutine twice whenever it was called by the main 
nonlinear programming code. The increase in time for each 
problem represents a fair estimation of the total CPU tine 
being spent in the user subroutine. These results are shown 
in Table III-3. Each problem's percentage is an average for 
Pew three different Starting points that were used for that 


problen. 


48 





Gable Iili~3. 


Proportion of compute time spent in user subroutines 


Problem SUMT GRG GRAVES 
1 oa" ~042 Eo73 
2 - 800 ~459 2207 
3 ~-419 ~465 Sis: 
4 2033 sod eei2 
s. 886 # 02 4 515 8. 
6 ehtalt 2442 ; 2123 
7 21oS 4 S15 ~413 
8 704 # So38 s{oss 
#-numerical differencing was used fOr some 
Gonstraints 
A. Algorithms! performance for each problem: 


The actual objective and constraint equations for 
each problem along with the results for each nonlinear 


programming code are included in Appendix A. 


Problen 1 

Problems 1 and 2 are both examples of 
determining the chemical composition of a complex mixture 
under conditions of chemical equilibriun. Problem 1 
included 45 independent variables and 16 linear equality 
constraints. SUMT and GRAVES returned the best solutions 
and GRAVES solved the problem approximately 25 times faster 
tan SUNT. SUMT and GRAVES obtained identical resuits for 
all three initial points while GRG fluctuated slightly. The 
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objective function and derivative subroutines for Problen 1 
were demonstrated by Professor Graves to be inconsistent as 


oN appreacnes zéro and he provided a special alteration of 
jk 


this problem for his code, which requires continuously 


differentiable functions over the entire bounded region of 


y(e). 
Problem 2 


PiEQobenecawas also a chemical equilibriun 
problem which had been redefined in the Himmeiblau study 
from a Bracken and McCormick problem [Ref. 12]. All three 
codes solved the problem handily with GRG having the best 
‘time. GRAVES was not able to obtain a feasible point from 


one of the alternate initial points. 


Problem 3) WaS formulated by the Shell 
Development Co. HOME tNC mon NGindie COlVidle study and 
consisted of 15 variables and 5 nonlinear inequality 
constraints. SUMT and GRG returned identical solutions for 
all three initial vectors but the GRAVES solution was less 


brecise. 


Problem 4 


(5 


The problem waS Maximize the area of a 
hexagon in which the maximum diameter was unity with 9 
independent variables, 13 nonlinear inequality constraints 


and a lower bound of zero for ae The consistent results 
and low tires in Table I1II-1 belie the difficulties 


encountered by the codes. GRG consistently returned with a 


local minimuad value of about -0.4 (-0.866 is the global 
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Minimum) until a phone call to Professor Lasdon resuited in 
an alteration to one of the tolerances utilized in the 
internal GRG subroutine DEGEN. Without this professional 
aid from cne of the co-founders of the code it is doubtful 
that GRG would have ever attained the global minimun. 
GRAVES was not able to attain the same level of accuracy as 
SUMT and GRG. This problem contains many local minima and 
Bet and GRAVES each converged to -0.675 from one of the 


alternate initial points. 
Problem 53 


Problen 5 1s probably the most difficult 
test case in this study. It includes a linear objective 
function, 24 variables, 12 nonlinear equality constraints, 2 
linear eguality and 6 nonlinear inequality constraints. The 
independent variables are also bounded to positive values. 
GRG returned a quick and accurate solution from three 
different starting points. However, with an initial point 
sg = 0.4 GRG was not able to obtain a feasibie point while 
SUMT was able to reach the global minimum from all of these 
points. SUMT, which is not expressly designed to. handle 
nonlinear equality constraints, required over six minutes 
for each cf these solutions. GRAVES, which appears to be 
Pemoeectisitive to the initial point than the other two codes 
had the best solution time from the original point but was 
not able tc locate a feasible solution when uSing the 


alternate starting points. 

Because of the complexity and nonlinearity of the first 
12 constraints SUMT'sS numerical differencing subroutine 
DIFF2 was utilized to compute the Hessian matrix for these 


eonstraints. 


Preblem 6 
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Prcblem 6 waS a weapOn aSSignment problem 
with 100 independent variables, a nonlinear objective 
fmmietion, 12 linear Constraints and zero lower bounds for 
the variables. All three codes returned approximately equal 
objective solutions although the actual variable values were 


quite diverse. GRAVES and GRG were twice as fast as SUMT. 
Problen 7 


This problem was adapted from an inventory 
feeere created by D.A. Schrady and U.C. Choe [Ref. 13]. The 
xX (€) (1=1,...,50) represent tne reorder guantity for 50 

1 
inventory items and <x (e) Gioia, 100) represent the 
1 


reorder points for the same 50 items. SUT eas a lal 


obtained consistent results from all three initial starting 
points but GRG encountered severe numerical problems fron 


the alternate starting points x (+) = 10 and x (#) = 1000 
1 a: 
feed, ..., 100) and aS a result produced correspondingly 


inferior sclutions. GRAVES was not able to reach the global 
minimum apparently because of the utilization of an external 


FORTRAN subroutine to approximate the culmulative normal 


~-7 
distribution. This subroutine was accurate only to 10 and 


the gradient calculations showed inconsistencies because of 
this lack of precision. Again to guarantee convergence the 
GRAVES algorithn requires continuously differentiable 


munctions. 


Problen £ 


oe ow 


Problem 8 was adapted from an entropy model 


proposed by A.J. Scott [Ref. 14]. The nodes in Figure A-~1 
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illustrate 46 population centers connected by a 
transportaticn network, represented by the connecting arcs. 
USing a congestion cost function the model yields an 
equilibrium soluticn that identifies nodal populations as 
entropic functions of the total cost of the journey to work. 
All three codes returned Similar solutions with SUMT leading 


the way while GRG made itS worst showing. Starting with 

fee) = 10.87 {(1=1,...,46) GRG located a local mininmun of 
1 

~2.96 (global minimum was -3.47). SUMT was generally twice 

as fast as GRAVES when they both returned global minima. 


Ds Conclusions and Summary: 


Perhaps the easiest way to summarize the results of 
this analysis is to return to the evaluation criteria which 


were listed in Chapter 1. 
ipeenhcecuLacy sor the final Solutions: 

SUMT was able to attain the best solution for 
all eight problems while GRG fell short on Problem 1 and 
Problem 8. GRAVES found the global minimum in five of the 
eight problens. 

2. Robustness: 

Again SUMT wWaS superior going to a local mininuno 
only once (Problem 4) while GRC had variances in the 
precision attained for Problems 1,5,6,7,8. GRAVES in two 
problems was not able to locate a feasible point when 
Starting frcem cne of the alternate initial vectors. 


3s) Speed of Convergence; 


S Uiivie, while Very reliable, was also very 
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deliberate and could not compare with GRG in the CPU time 
category. GkG was anywhere from 3 to 30 times as fast as 
SUNT. The solution times for GRAVES were inconsistent but 
fOr problems 1 and 5 GRAVES was from 1 to 9 times faster 
than GRG. 


4. Ease of preparation for user subroutines: 


SUHT required the most effort because of the need 
to evaluate the Hessian matrices. GRAVES was considered the 
Peetest £0 tise because of its superior technique employed 


Peeeainitiating and altering tolerances. 
5. Aids for Debugging: 


All three codes provided fine methods for comparing 
the consistency of the gradient and function subroutines but 
GRAVES was clearly Superior because of its additional nain 
program CONTEST which required only about 95K bytes of main 


memory for 100 variables and 50 constraints. 
6. Readability of final and intermediate output: 


All three codes have very comprehensive output but 
SUMT only allows two levels of printout while GRG and GRAVES 


have six possible levels. 
7. Failure node: 


The GRG code would explain in very concise but 
clear language the reason for terminating its solution 
attempts. A simple cure for most SUMT difficulties was to 
give it mcre time. GRAVES had many options available for 
the user tc employ when the solution was not forthcoming. 
Unfortunately there were too many options and the user at 


times was overwhelmed with possible alternatives. 
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All three codes have advantages and disadvantages with 
the choice of which to use being controlled by each problen 
and user's special circumstances. SUMT 1S alwayS very 
e@eccurate. GRG is usually fast, quite accurate but requires 
a substantial amount of memory Space. The GRAVES code when 
properly tuned provided tremendous results with low time and 


memcry requirements. 


The GEG code, except in computer centers with 
restricted memory availability, is probably the Superior 
choice of these three codes although SUMT was able to 
consistently attain the global minima from all initial 
poernits. Although not a generally distributed code, because 
of its lcw core requirements, the GRAVES code seems to. hold 


prcmise for jJarge problens. 
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APPENDIX A 
TEST PROBLEMS AND RESULTS 


— =a 


Probien 1 


Beuece: <A.F. Jones, "The Chemical Equilibrium Problem: An 
Mpplication cf SUNT," Research Analysis Corporation, McLean, 
eee RAC-7TP—272, 1967 [Rert. 15]. 


No. of variables: “5 


MomeoL CONStraints: 16 linear equality constraints 


Waiective function: 





i k 
. me 
, ae jk 
Pemiimize:s £(x) = X Go t+ LN 
jk 3 n 
eee K 
k=1 = 1 a 
4 Pe 
yet 
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_k 
aio) = oe ~b =0 R= Dy GC 
1 Lik ijk 1 
kat | J=1 
¢ 200 1 = i paoe 7 | eee ea 
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De'S and c 
: 5k 
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"set Or PrecnlLen 1 


Cc 


i jk jk 
1 0.6529581 bf 0.0 6 3 0.0 
2 0.281941 De A07 -7.69 ee: 2.2435 
3 Be 05233 3° 1 =11.52 8 3 0.0 
u  47.00022 4 4 36.60 $3 3 £~39.39 
5 47.02972 1 2 -10.94 10 3 ~27.49 
6 0.68005 2 2 0.0 Vie pe eee 
7 0.08813 ce” 0.0 12 ee 6.12 
8 0.04829 uo 2 0.0 joes 0.0 
9 0.0155 5 2 0.0 te a: 0.0 
10 0.0211275 6 2 0.0 15 3 ~ 1.9022 
11 0.0022725 ae Cate 16 3 ~2. 8889 
12 0.0 a, 2.5966 17 3 ~3. 3622 
13 0.0 9 2 4-39.39 18 3 ~7.4854 
14 0.0 1G 2 eo. 35 1 4 -15.639 
15 0.0 14-22-32. 84 2 0.0 
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po 8 0.0 a2 05 18.9779 
3 3 -0.50 i 5 0.0 
yo 3 0.0 De 11.959 
5 3 0.0 ae 0.0 
oe Be 12.899 


27) 





Data for Problem 1 
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Problem 2 


Source; D.M. Himmelblau, “Applied Nonlinear Programming," 
M@eeraw=-Hill, Inc., New York, 1972, p. 396. 


No. of independent variables: 10 


Noe Of Constraints: 3 nonlinear equality constraints 


mective function: 


10 10 
SD X 
ae 1 1 
menamize: £(x) = | e Cat Oke, 2 ) e 
1 al poe 
1=1 eq 
Geomstraints: 
2 X ri X X 
1 2 3 6 10 
h (x) =e A> + 2e + e + e ae. =) 
nd x me ne 
4 5 6 7 
he (*) =e + 2e + e + e - 1 = 0 
x X x os i 
3 7 8 9 10 
h (x) =e + e + e + 2e + © - 1 = Q 
where c = ~6.089 C. = ~17.164 Cc. = -~34.054 C. = -5.914 
i 
c = ~24.721 c = ~14.986 e = =24.1000 
5 6 7 
mee 10.706 c = ~26.662 C =e D2 49 
8 S 10 
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Results for Problem 2 


Thitia L GRG Suh Tt GRAVES 

£ (x) ~21.015 -47.75 -47.76 -47.76 
x a2 503 ~3.61 -3.17 -~3.84 
xX, =2.3 -~1.92 -1.88 = Ps OG 
x -2.3 -0. 246 -0.254 -~0.316 
x -~2.3 =5,58 -6.58 -5.92 
Xe -2.3 -Q.723 ~0.723 -0./26 
x. =. 3 = ot -7.19 -6.04 
x ~2.3 -3.82 -~3.61 = 359 
X =2.3 ~4U.14 ~G.02 ~4.22 
SX Bee) ees -3.39 =o ae2 -2.93 
9 
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10 
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1 
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h(x) = so G 8.08F-06 2.0E-09 0.0 
Time WAL || IS Gior 9.34 sec. 14.83 sec 


Alternate Initial Foints: 


ex. = 2.0 Lelpoosy ie 
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b) x = -5.0 eae cea 0 
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Problen 3 
Source: Shelli Development Co. (cited in Colville, IBM N.Y. 
Pemeeecenter Rept.320-2949, June, 1968, p. 22). 
No of variables: 15 
Peoweor cOnpStraints: 5 nonlinear inequality constraints 
15 bounds on independent variables 


Momective function: 


Oe 5, poe 2 
i. ‘ 3 
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1=1 $57 154 j= 1 
where Vee. Xx 
ey oth Ot a 
and Zee x 
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5 10 
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: J J tjoi 
1=1 i= 
eo ea, Ds | aera 
3 


64 





bata f 


v, » PDP DP DP DP DP DP PP PW B&F AA AAA 


Oo DON HD MN & WwW NH 
CJ. O. OF Us Ch Ch ts. 


-40 


Or 


-_— Ol. 
» de 


wt ( F&F W NO 
LJ. . Cs 


> 
e (LI, 


103 


Alternate 


a) 


r) 


x 


i 


Preblenm 3 


1 2 
~15 = AT) 
30 a0) 
=U a8 
= 10 =e, 
Be 2 | 
~10 32 
4 8 
AG 2 
0 -2 
= 55 0 
0 a 
0 = 5 
2 0 
mal -1 
-1 a: 
1 2 
1 1 
De Be D, Br 
Sree, 29 ~4 ~4 
iittiea. Points: 
= 5.0 = Wenmere 9) lS 
= 15.0 d= 1, ei-eceml 


65 


~40 


-60 


-1 


=2 8 


= 
= 





Results for Probiem 3 


Ti esd 1 

fe ( X} 2400.1 

x 1.0E8-04 

x. T.OE-O04 

x. 1.0E-04 

X 1. 0E-04 
4 

x 1. 0E-O4 
5 

6 1.0F-04 
6 

x 6.0F 01 
7 

x 1.02-04 
8 

X 1.0E-04 
9 

X 1.QE-04 
10 

x 1.Q0E-04 
11 

x 1) SO es 
12 

x 1.06-04 
iz 

ye 1,.0E-0O4 
14 

x 1.0E-04 
iS 

h(x) eon 0% 

h(x) oe saa 
h(x) ete 04 
h(x) fil Ot 
h_ (x) tao 04 

Tine 

Problem 4 
Source: Oe) De Pearson, 


Minimization, Research 


GRG 


32.349 


0.0 
0.0 
Be 2 
0.9 
3206 
PVc65 
0.0 
0.9 
0.1 
0.0 
O23 
0.33 
0.39 
0.43 
Oa2Z 
4.9E-08 
Ze oe ls 
ooh O16 


On Variable 


Analysis 


Memean, Va., May, 1968 [{Ref. 16}. 


66 


SS iyah 
Sea? 


1.7E-06 
3.1E-05 
Bre 
W.4E-05 
3.06 
17.84 
1. 6E-06 
1. 1E-06 
Ont 
8.9E-05 
je 
0.33 
0.40 
Cease 
DE? 
2.0E-04 
1. 85-04 
1.5F-04 
1.45-04 
2.7E-04 


13.7 sec 


Metric 


Rept. 


GRAVES 


Size 2 


0.90 
0.0 
Det 
0.0 
3.07 
ean eas 
6.3E-04 
0.0 
0.16 
Q.0 
OS 
0. 34 
0.40 
0.44 
0.24 
1.4E-01 
Veo Os 
8 .8F-01 
ose 8) 
Yona O2 


37.07 sec 


Methods of 
RAC-Te-302, 





No. of variables: 


hee of constraints: 


Megective function: 
Maximizes: 


f(x) = 0.5 (x, 


@emsctraints: 


1 
es © 
=X, = 
iP = Le = 
Utes Ss = 

1 


9 


13 noniinear ineguality constraints 


1 upper bound 


ee ee Ke kX eX XS Se XX) 
eee 3 9 5 9 8 6 7 
7. 2 
a ee a ee 
3 uy 
Z 
i~ x 20 
g 
Ve Zz 
1- x ~ x 290 
6 
2 2 
te amen On ee} 2 Q 
1 2 9 
2 y 
eo) AX ee a 20 
‘ ( )* > 0 
x = Nee 2 
Z § 
2 2 
Sa) os soe ee) | OS UO 
6 
2 2 
a) ae a GaN ay ea 
u 8 
y* > 0 
-— x C= Ky = xX 2 
9 
Xe ea eX 7 Sa 
1 4 CS 
XOX 22a 
3 9 
ma? Gey. een (0) 
5 9 
ne SKN ao 
5) te 6 7 
eee 9) 
9 


67 





Results fer Problem 4 


at X) 


® “ a uy > Gd N ~ 


aoe, 
Ss 


pws 


—, 
a 
re 


oe > i 2 ee 2 2 ee i 
N 


eo 
[al 
mS 
weet ee 


(x) 
(x) 


Time 


Alternate 


a) X 
1 


b) x 


initial GRG 
O70 =. 866 
1. 0 =J. 0005 
1.0 2S OS, 
eo 0.866 
270 =e 
ie 0 Oe.0 
eee -1.0 
Pane 0.866 
ele Jeo 
Sse 22053 
0.0 -6.6E-05 
-~1.0 Oa 
O70 2 eS 
sO &.1E-05 
12.6 —2 oh Oo 
iec0 Zalh— 13 
ie 0 =1.55-06 
0.0 255-0 
OG. 0 -2./2-06 
0 Oe sibiG 
= ila -1.6E-19 
G20 0.866 
0 ieee @ 
3.07 sec 
invcial Points: 
= -1.0 11 plea O 
=o. 0 i= epeetcen, 9 


68 


SuUsMT 
= 306 


5 Cee, 
sO Line ie fo 
0.469 
0) a teneve: 
Oe 10) 
=O, oH 
0.469 
=O Od 
ois Se Oe 
7T.4E-01 
Boe OG 
aa tr OO 
iat =O 
ert 05 
jin Zils 
ait Ot 
ele -05 
Gio 0 
Z2-4E-01 
Ze te O01 
os 0 
Sele O 1 


6.7 sec 


GRAVES 


= One 2 


~0.014 
Sa 
O23 52 
=U.0 12 
eG as: 
SO, 
0.858 
sO eure 
Pesos 0) 2 
8-2-0 4 
io GO 
L003 
Sy ate) | 
0.0 

oe EO 
CoO 
Ser) eed 
Eee td) | 
3 65-01) 
6sOE=03 
8 .6E-017 
8 .6E-01 


14.4 sec 





Problem 5 


C.A. 


Austin, 


Source: Paviani, 


Texas, TeX., 


No. of variables: 24 


foeeeot constraints: 12 


2 


2u 


Objective function: 


Ph.D. 
1969 [ Ref. 


dlesertation, 
Lae 


The University of 


nonlinear equality constraints 
linear equality constraints 
nonlinear inequality constraints 


bounds on independent variables 





Peemeamize: £(x) = eo 
sual 
1=1 
Constraints: 
x ole 
(i+12) eo 
(x) = aaa =o) ne So iene scree yal 2 
a 24 12_ 
b ee 4 Ob * 5 
a Ig. ~a D>. 
j= 13 y j=1 J 
24 
h i a nd 0 
13' , aT 
1=1 


69 














x x 
a i 
m6 6(X) C= + £ a - 1.671 = 0 
14 d. on 
i 1 
1=1 1=13 
14.7 
where f= (Oe CO (OSU) la 
4 Q 
x, (14+12)} 
i (x) =~ e 2 G i= 1h 
(i+ 14) 24 1 
X 
ars 
aaa P4 cnr 
we (i415) 
h i (x) acd 2 0 a. = ono, 6 
(1+ 14) Ll 1 
xX. 
: 3 
Sis 
ae) SUG Sl ee a 
1 


70 





Data for Problem 5 


Owty DO WM FSF Ww bh = 


ht) Kh B NO NO = = = = S| es = lS Cl! 
i GS NS) at © 10 © -) OC WO ££ &@ / a 6 S..UlU} 


a 5 
1 
0.0693 
0.0577 
0.05 
paon 
Ge26 
0.55 
0.06 
mare 
eae 
0.18 
0.10 
0.09 
0.0693 
0.0577 
0.05 
0.20 
0.26 
0.55 
VEY 
0.10 
Ome 
0.18 
0.10 
0.09 


D 
at 
44.094 
5 Gs lz 
Doe 12 
137.4 
120.39 
it Oe 
O25 504 
84.94 
1335425 
82.507 
46.07 
605097 
44.094 
Byishy lv 
ye, | 
137.4 
tZ0eg 
Bee 
624 2100 
84.94 
32425 
O2e 07 
46.07 
hile, (OS) 7) 


2 Sree 
Sy) aa) 
45.7 
TH.7 
84.7 
27 ad 
Oo.) 
7.1 
2.1 
Viet 
O65 
0.64 


31.244 
oO 2 
34.784 
Zo fi 
82.7 
91.6 
56.7 08 
Ozer! 
80.8 
oo eon i 
“9.4 
Vo | 





Results fcr Problen 5 


£ (x) 


wy 


N 


Gl 


> 


Wn 


Or 


« 


12 4) 


Oo 


ja 
© 


rw" 
ws 


7) 
N 


im 
GJ 


ps 
> 


ps 
4 


~s 
o) 


o 
«] 


pe 
© 


wy 
0 


N 
oO 


N 
~y 


23 


~ «~ M MR KK MK OK KK OM OOK KKK OK 


initial 


0.14696 


0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.Q4 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0.04 
0. O04 
0.04 


= 299 SM ae Oa 


Zaeu-02 


GRG 


= 2668-02 


2. 85-09 
1. 1E-07 
US Bo 10) 
0.0 
4.9E-14 
Grew 
O02 
0.0 

OES 

0.0 

0.0 

We tee 2 
0.0 

a 2/0 
2290 
Oe 

020 

On 0 
2 
a 

0.0 

0.0 

Oa0 

4. 1E-O4 
= OL = Uo 
Tillis OR 


Ue 


SUNG 
Ie SOO R02 


2. 1E-07 
1.1E-01 
1.1E-01 
1.3E-07 
2.85-08 
2.7E-08 
7.6E-02 
9.1E-07 
6. 1E-07 
1.4E-07 
1.3E-05 
1. 1E-02 
1.5E-06 
1.95-01 
2.9E-01 
1. 1E-07 
1. 35-07 
4. 02-08 
2.1F-01 
3.7E-07 
7.6E-08 
1.58-07 
6.5E-07 
4. 1E~04 
1.3E-09 
-1.7E-09 


GRAVES 


35 NGI 


Cea) 
eed eat 
1.1E-01 
0.0 
0.0 
0.0 
eo 2 
0.0 
0.0 
ete 
oO fg 
We Peer 
O 518 
eo oe 
Zao BO 
0.0 
Ose 
0.0 
I ENTS AG 
C18 
0.0 
OAS. 
Osh, 
4.1E-04 
OES 
ore 


ya 





anitia l GRG SUMT GRAVES 
h(x) rae = T= Oe -1.4E-09 
hy (x) 2.8 8=0 2 1205 20 US Ble) 
h_ (x) -~5.6E-02 1.7E-13 -9.0E-10 : 
h. (x) 1. 1E-02 7.7E-21 -1.3E-09 : 
h_ (x) -2.4E-02 ee a7 Oe Be 10 O70 
h , (x) 54 SRSA aia U4 1255-10 OA, 
ho 0) 4.,3E-02 3.6E-35 1.9E-09 O50 
hi, (*) “.1E~02 Teon= 2 | a Atseeo | | O20 
Al, 4) We HES 1 = 2) 2) 315) 3.6E-10 G0 
h , (*) lO Be 0 2 3) cb =40)S) 6.0E-10 Od 
ho, aie OR— 2 pola ly 117) —-4.6E-10 Oe 
h(x) -7.3E-01 2.4E-11 4. 8E-12 0.0 
h , (%) imo Oz 1h Oe 07 1.0E-01 (POR 0) 
h, &%) Jo 2D AU =-6., 1E-10 2268-06 0:50 
h 5) eos On -~9.85- 11 por Uo C=C 
h , &%) 2.2E-01 ie ZO 1. 2E-02 Bei 8 
hi, (*) 5) ZooBOM OOS) 1 6.0E-01 Seu hed 
ho, &*) Z2a25~0 1 Sei « | 3.0E-01 SU Ot 
Time 13.85 sec 385 sec S05. See 
Mmeeernate Initial Points: 
a) x = 0.08 1=1,...,24 
5 
b) * 11) ME letters 2 


as 





Problem 6 


Source: J. Bracken and G. Pes MEGOERRICK. "Selected 
Applicaticns of Nonlinear Programming," John Wiley & Sons, 
mate, New York, 1968, p. 26. 

No. of independent variables: 100 


memeot constraints: 12 Linear constraints 


100 lower bounds on the variables 


Objective function: 


20 5 
Xx ‘ 
ee 1) 
feenemizes = £(xX) = } vie a as 
—— J 13 
j=1 1=1 
Pomstraints: 
5 
X Sa Dt 22 aro) j = 1,6,10,714,15, 16, 20 
1) 2 
1=1 
20 
a X. Wee. sce) L = 1.444;72 
13 1 
j= 1 
Ko, 0 TE ey eerie je NG ere, 20 


74 





Data for Problem 6 


Ci as ee) ND ee 


oO OD SN 


12 
13 
14 
15 


16 
Tu 
18 
19 
20 


SSeS: 
- 90 
- 85 
- 80 


ok ak eek 


200 


84 
oS 
85 
84 
85 


81 
Ot 
ao2 
80 
- 86 


298 


88 
87 


. 88 
85 
84 
~85 
=o 


100 


a 


15 


is 


0 
oD 
- 96 
720 
- 96 


- 90 


Se) 
eo 
SL) 
oO 


a9 
oo 
sl 
98 
oy 


298 
Als: 
2 
os 
eo2 


300 


ote 


5. 


aot 


eS 


Seligy 


aa 2a ast otk 


150 


75 


eZ 
94 
noZ 
oe 


Sh), 


5 
7210 
| 
Sele) 
ane), 


oS ey ef es GS 


250 


ake 


100 


40 


50 
70 


35 


10 


60 
50 
50 
jas. 
40 


°60 
35 
30 
AS. 


30 
45 
i> 
200 
200 


130 
100 
100 
100 
150 





Results f£cr Problem 6 


initial GRG Sui GRAVES 
x (¢) 100.0 below below below 
n(x) i = 0 = Ne 39.0 = SAW, 20. 
h(x) 1900.0 18.0 Zee 216 
h, (x) = 900.0 cathe 6.4E-02 Oe0 
h(x) aorlee 0.2.0 1220 1 ey BU 
hy (x) 110150) .0 es el) 8.7 8 ti 
h. (x) -~1750.0 Omas- 13 Ors We. 
h (x) 470.0 133-0 Ons iS 
hl (x) 400.0 52 atl a Are 50m 
h (x) 460.0 Sete IS OY Og 
h | (*) 450.0 Gero a la O02 0.0 
hi, (*) 430.0 lar ee 12 S2 on O02 0.0 
ho, &) 465.0 tee als Sat O2 0.0 
ho, ©) 490.0 S23h- 13 Dene OZ 0.0 
Time 51 sec. 123 sec. 4u9 sec 
Sore 270K 194K 138K 


Peeternate Initial Points: 


a) X = 10.0 Xi. i ea ee = 6 Vaso 
15 Za 33 
x = 7.5 X = 12.5 j=1,.--,20 
4 at 
b) x. = 10 Dales ety 2 jHt;.--,20 
13 


76 





Weapon Type 1 
iene Ul 


ma get 


= i _- i _s SoS 
(89 Hse BB ae ee 1S 3B =F COO) = th eel ed Sco 
LOW = TWOwoO Oe = WANN MANN oc. oS 
i | aaa an: LS ie Wie 
ae I pal B ONO CO Omdods Say Toa Ga Ci Oy Wh 
zr =s = Se Nott OG) Mecaat | inant ae 
le ps reas { t 
{ 
~ 
" 
t i | t 1 
Wh ot N tv) asin 
t sr) ce GN co = 
i t t 
t—- t fs { — 
WON WO NMN nl SEP LS @ 
ee t tNN west! Ga ae 
~~ t— 
t i _ 
co Vo Fun giten ¢ en gil BG @) 
I fac C m™ OO 
— }~ 
- UN YY Sf Ww) oO 


= T= 
ma ee 
ci 


21 
iS = 


10 
11 
12 





Weapon Type i 


Total 


far get 
3, 


~13- 


es 


She 


= file 


~5- 


58 


14 


50 


| 
pias, SK a 
OY tad te 
} wo? 
t 
™ 
' 
! 
WO 
L ened 
b 
ta 
a oa 
za 
| wert 
i 
MOrionwo 
NAAN 
1 al 
! 
© 
oo 
' 
uw) 
Lend 


- 8- 
(24) 


16 


17 


=e 
57 
=i 


18 


Uae 


250 


-12- 


62 
52 


20 


Totals 


denotes GRAVES variables 


denotes SUMT variables 


) 


no brackets are GRG variables 


78 





Problem 7 


BOULCE: Adapted from a model proposed by D.A. Schrady and 


fee Choe, [Ref. 13]. 
No. of independent variables: 100 
moreot COnstraints: 1 linear constraint 


lenenlinear constraint 


S50 lower bounds on the variables 


Megective Cunction: 


B(x, + 50) 
2 Al 


minimize £(x) = 


where 


” 1 % “) ad a 
B (x + =—js +d i mes de : 
i' al 2 ne et 31 p ae Piao me 


and d = xX nm 
2 (i +50) iL 


new 
igs 
tt 
ig 
42) 
NO 


\ 
D(x) dx 


c 


54 
ws 
T 


no 





Constraints: 








50 
x, 
oa at ae 
2 Cine 0) 
1=1 
50 
L 


xy 
NO 
{ 
ras) 
a 
IV 
© 


a 
{I 


1 
1=1 
2 =| oe oO 
200,000 
300 


at 


IV 





Data for Problem 7 


Nn = WwW mY = 


oO Oo DB NO 


12 
13 
14 
15 


16 
17 
18 
19 
20 


21 
2 
23 
24 
Be. 


by 
aL 


1000 
1500 
2000 
1100 
1900 


700 
400 
1200 
2000 
1300 


1700 
1800 
800 
700 
1100 


1000 
1800 
1500 
2100 
1600 


20 
17 
ve 


12 


19 


21 
16 
hs 
19 


12 


18 
16 


14 
21 


14 


81 


100 
ZO 
300 
200 
100 


200 
200 
maele) 
500 
300 


100 
200 
400 
500 
400 


300 
200 
100 
100 
100 


200 
200 
400 
500 
100 


100 
100 
200 
100 
100 


200 
200 
100 
A 0): 
100 


100 
209 
200 
300 
100 


100 
200 
100 
100 
100 


100 
200 
300 
100 
100 





Z6 
Be 
28 
29 
30 


31 
32 
ae. 
34 
55 


36 
34 
38 
59 
40 


41 
42 
43 
Gu 
45 


46 
4] 
48 
49 
50 


700 
2000 
1800 
1700 

700 


1200 
1100 
1700 
600 
400 


1900 
1900 
1500 
1400 
1200 


1300 
1900 
2000 
VAUE 

8C0 


1900 
2100 
2000 
500 
900 


13 


a 


17 
15 
18 
16 


WZ 
15 
20 
23 


V7 
16 


liz 


82 


100 
200 
500 
200 
300 


100 
100 
200 
300 
200 


100 
OO 
200 
400 
SUS 


100 
200 
300 
400 
100 


200 
500 
500 
100 
100 


100 
200 
300 
200 
200 


100 
100 
100 
100 
100 


100 
300 
200 
300 
o0n 


100 
106 
200 
200 
100 


200 
200 
BOC 
100 
100 





Results fer Problem 7 


th 
-—, 

>s 
al 


> Ss s os >s Ps os ss s Ss >< s * ~ Ss < ms ~% hen} ms ~ ms ss ra < Ss Ss 
nN N N) N nN N N ~ as fm = pet a he an a be 0 ea) N On 8h) > Ww N ~ 
oO a + WW N me oO Ye) © J Cn 93 > a! N) fms © 


MN 
N 


ithit aa’ 


2006.2 


B00). 0 
300.0 
300.0 
SCO 8, 
800.0 
300.0 
300.0 
S00 0 
SU ae 
3.010. 0 
300.0 
=) 010) 510 
SOOT 
S00 <0 
S00 -0 
SOOT 
300.0 
S005 0 
300.0 
3900.0 
300.0 
300.0 
300.0 
300.0 
300.0 
SOI 19. 
300.0 


GRG 
en) A tele 


Sh ei ges: 
205 5 
230 
154.48 
| ue 36 
235.21 
ee 510 
1D 7 
Y72.64 
245,15 
i Seo8 
203.45 
2570) 
294 12 
206.55 
ZO9 6 
252.24 
208.00 
132.43 
ls 7016 
Tyan | 
Pipa | 
eS aS, 
300.04 
166-27 
Pero 
29 0 


SUMT 
S0.73 


441.75 
22 Ge l3 
232 
Vose 
1683597 
Zoo 
187.01 
45 She) 
479.21 
eh 775 
| ESS sakes 
203 . 20 
2c 2 
Zein 0 4 
Bowe SZ 
BO 16 
223.34 
YAU 
Bond eee 
Poe! 
18) oS 
Zoe | 
335 74 
Pe) Ro, 
ot 75 
FG AT oO 
Ziomle so 


GRAVES 


[P13 bs 


JG.) 
253.48 
SOs) 1 
[Debs eras. 
es) Shs 
Pos 
Rete 3 
25304 
S07 ao 4 
IZ Sib ate! 
VG) 2 
224.15 
20147, 
astern te, 
1g si Sh) 
ZO oe 
344.82 
2 SG eo 

eo .00 
Ta aens 0) 1! 
17220 
244.51 
328.76 
Breer 
Pare tS) 2) 
164.98 
240.90 





~ «SM oh MK Kl OOOO OM OOOO OOO 


hn nH oa) 1) wo On + > > + & > > > > > e) Gl wl 1%) Q Gl) QJ ul GJ wl N a) 
n > ou N = © © @ | oO on > Ww N — o © o “N oO W > GQ) \% = © ¢) © 


8) 
oO 


Ty (eh iwales wk 


300.0 
SO) a8 
300.0 
300).0 
SOU, 
BUNCE 18, 
300.0 
300.0 
300. 0 
300.0 
S00 C 
300.0 
300.0 
S00. 0 
300.0 
300.0 
300.0 
300.0 
S010. 0 
300.0 
300.0 
300.0 
300.0 
500.0 
200.0 
300.0 
SHON aAG 
300.0 
50.00 


GRG 


St 1S, 
25659 
oz 2 
154.25 
170.06 
228.43 
toga ss 
ER EN Sse | 
2621-6 
398.07 
Zee oO 
JES) By NE 
The) aye Ui 
240.384 
Z 0G. AEG 
248.06 
240.71 
V3 Oma 
VAG esa i. 
252 0 
407.32 
147.50 
156.36 
Sige) 
SSE IAS 
554.60 
327206 
20 lee 
53 32456 


84 


Sori 


431.79 
598.64 
192.76 
152.90 
169.53 
220.55 
155.54 
293,51 
272.91 
299.71 
230.32 
283.78 
278.89 
247.65 
207.65 
248.49 
Dias 
(oe 
DEO ie 
248.52 
109.01 
146.09 
158.08 
297.76 
334.50 
554.64 
322.53 
202.46 
543.68 


GRAVES 


365.20 
By Al8) AG, 
6) oi ad 
104.03 
220.00 
Wi Sa.0 
Pa iter sNG, 
200.04 
2538590 
343. 80 
254.82 
439.54 
SIS) ENS), 
Zot ou 
190.48 
210.33 
276048 
299.00) 
22 
Satie 2 
O07 aes 
107255 

95.74 
375et1 
ZOD ai 
TIES SN 
BeGoB) B.S 
194.65 
486.93 





~ §~* —© KH KH KH MH KH MH MH MH NM HK MK lll lllllUMlUlUMKULUlUMlUlUMlUlM OM 


Ww 
~w 


89) 
© 


h 
a) 


o 
© 


Oo 
~ 


o 
ay) 


oO 
GJ 


o 
> 


an 
wn 


oO 
rey) 


mo 
“N 


oO 
© 


cea) 
ve) 


“ 
© 


“J 
~ 


mm! 
nN 


~ 
uw 


~ 
& 


~ 
+) 


N 
oO 


a} 
“J 


“ 
® 


N 
0 


6) 
© 


fe) 
pa 


© 
N 


fa) 
Ou 


eee a. 


300.0 
300.0 
300.0 
300.0 
300.0 
300.0 
300.0 
300.0 
200.0 
300.0 
a0. 0 
SOKO 
B00 2:0 
300.0 
02, 0 
SHOU L 
B00). 0 
300.0 
300.0 
300.0 
300.0 
300.0 
300.0 
300.0 
e020 
300.0 
B00... 0 


GRG 


5) We lsite: 
416.59 
893.45 
455.3 1 
205.00 
488.69 
Gs O21 1 
916.04 
538.04 
WS Sh 3), 
494.65 
264.98 
DIME AEN, 
1 av NS 
a 3003 
52.035 
940.70 
63:920'S 
222006 
(a SHOES, 
42.25 


hi0Seu 


654.97 
SiS V4e che 
216.50 
Sah e 
63 iS 


85 


SU 


D2 oot 
417.16 
Bits Sis. 28: 
GHGs 35 
Z0 563 
488.64 
Os 2 
913254 
Sel) 8) | 
gel sell 
494.78 
264.70 
22 eo) 
224.66 


S20na0 


453.08 
944.58 
642.67 
Boe. Oo 
TSENG: 
492.03 


LOSS 6 Se 


624.10 
Sn S) Ares ie. 
Za lo 
234.21 
C3525 3 


GRAVES 


198,57 
368.46 
Oe lee siz 
ES ayy PAS) 
246.11 
TOO ais, 
SUS IL 
765.45 
SCG. 47 
524.78 
So oe 30 
1) SUS BRS Fe 
Pee Pee 
ZoG. 0 I 
PRSh8) OY 
403.50 
816.66 
61223 
184.75 
SEO 
39720 
S1Sens 
Seley le 
5 lo 
PRSIUR 1828: 
220.03 
oda 





a 2. 2 oe 2 + i 2 i 2 i 2 Ti 2 SE 9 Eo 
o© 0 © © © 0 060 © 0 © &® © &8 ® @ 
oN GO WH F&F VY NHN KF OO 0 RB ND HH 


ve) 
9) 


X 
100 
bh (xX) 


ho) 


Time 


Alternate 


a) x 


b) x 


nts. a tl 


80 


300.0 
800. 0 
BOO 
500.0 
300.0 
SOG 8 
2001 0 
50050 
5.0 04.0 
SHIN ate 
300.0 
B00. 0 
300.0 
500.0 
B00. 0 
300.0 
300.0 
650.0 
68.0 


Mie takt FOLNtS: 


10 


1000 


GRG 


454.69 
ee 
275.54 
3) 20) Pas 
483.80 
824.73 
I35- 50 
ISN LS 
Sas 
5) [ein iay 
652.48 
BN Sec 
469.03 
768.47 


UGS 70 


25 O69. 
236.84 


lary = V3 
2.45-05 


96 sec 


86 


S Ue 


$50.13 
412.73 
203.05 
O27 a0 
483.34 
B2G eo. 
945.03 
eS) 8 
324.64 
5976.45 
OS 4 O58) 
PA Sasa, 
468.47 
770.50 


1068.96 
258.82 


ia Pa, 


(a2 E=ON 
1. 98-04 


246 sec 


GRAVES 


ae. 23 
B52 50 
208.42 
V6ee00 
Sisie Gas) 
TODS 9 
Nee ND 
V9.6 
805.69 
ot Para 
S102 02 
Looe U 
387.54 
CGo—cs 


TOS OR8iG 


DN 2 
220.08 
gh SoU) 
SCE aUS 


234 sec 





Problen 8 


Source: Adapted from a model proposed by 
Aodmmeocore (Retr. 14 ]. 


No. of independent variables: 46 
fee Of constraints: 1 nonlinear ineguality constraint 
ieerrear equality constraint 


Homwtowe: DOUnRaGS On the Variables 


Megective function: 


46 
x X 
Cl. | a or | ae i 
Minimize £(x) = eee. = 
uy ak 
1=1 
Constraints: 
i! oad x = 0 
a 
1=1 
UG 
Goss Cy eat ay 2 0 
iy ot a 
1=1 
Wiere YeeSiky + X 
1 1 eae) 
Get) 


A(i) consists of all arcs (in figure A1~-1) that 


converge directly and indirectly upon nede i. 


x 2 0 eae eeerce- op tO 


87 





Mata [Or problen 8 


a = 0.05 
joy Sse) 
°@: =» 52:0 @: = 
1 2 
Ge nn Ane c = 
4 S 
cS = owe 0) ee = 
7 8 
cS = 12.0 e = 
10 11 
Cc = 21.0 Cc a 
13 14 
Cc = 9.0 Cc a 
16 17 
Cc = 20.0 Cc = 
19 20 
Cc = 96,0 (@ = 
22 23 
ec = 11.0 Cc = 
25 26 
Cc =o. 0 Cc = 
28 29 
Cc = 8.0 es = 
31 = pra 
Cc = 12.0 ec = 
34 35 
c = 16.0 c = 
37 38 
Cc = 8.0 c = 
40 41 
Cc = 11.0 cS = 
43 G6 
c — 
46 
d = c. 1=1 
ob i 


88 


14.0 


Za 


10.0 


tO 


14.0 


14.0 


Vig 


18.0 


fend 


S00 


10000 


Uae 


ZOU 








Figure A1-1 
me Sean sSpOobrtat3 
ration Routes for 
Prohien 8 


89 





f (x) 


* ha ss ss os os os Ss * Kas * m” Kas Kas ”s * 7s os os os *% os >s os >< os >” Kas >< 
N N fav) N N N N AY) ay) e = ms we me bes aad ca ae aa vo) @ | oO Bs) > GW N = 
fe) “ res) tn * G) N = a) Vo) @ ov! ra) vl > a! N) rae a) 


N 
oO 


Results for Problem 8 


Are ta 


=3a249 


40.000 
26.667 
86.667 
10.000 
13.333 
13.333 
13.333 
23.333 
23.333 
3.333 
ees 3 
3.333 
3.333 
3.333 
3.333 
3.333 
3.333 
6.667 
BES 33 
46.667 
6.667 
26.667 
10.000 
10.000 
10.000 
20.000 
3.333 
3.333 
10.000 


GRG 


=3.40 1 


34.86 
BPD) 5 Oe 
U2O0 
(Sid ae 
Wan o9 
13235 
VS oS 
LSS 
LEAVE 
8.48 
7.58 
9.26 
4.49 
So 
SS oN, 
oS 
8.67 
506 
4.56 
S468 
UBS, 
9.46 
NOG 2 
Se 
7.42 
Nee 
1.00 
2.96 
SOA, 


90 


SONY A§ 
-~3.468 


39.08 
45.24 
36.46 
19.36 
19.25 
i7e02 
19.97 
23.45 
31.56 
ie 
6.18 
8. 30 
3.75 
3.28. 
8.67 
8.02 
7.43 
6.70 
4.15 
19.96 
9. 86 
11.06 
14.91 
hee 
8.82 
16.33 
1.85 
Bone 
4.83 


GRAVES 


eo. 462 


37.14 
44.36 
40.81 
185 99 
W953 Z 
Vis 3 
20— 09 
ALA ANS 
30.48 
6.76 
6.03 
36 US 
Se, 
S108: 
8. 20 
og Ue) 
6.87 
6.38 
4.07 
Z lees 
3 ae)y) 
2350 
14.16 
Ail oe 
8.44 
16.71 
le od 
3.24 
4.71 





initial GRG SUG GRAVES 
X 133333 4.82 DN aloZ 6.28 
x O33 eS 16a 7.46 
x5 Bes o3 Seoe a9 4.92 
Xo e333 be2 4.69 4.29 
Xo 3o5.53 “8 4. 36 4.39 
ae ge es. Pre 3.07 Sad 
a Bos yr Oe 2 2.40 
x, Sess Sy ayZ a | A 
oe e333 5 Hae PZ Te ths: 
es 2A Be 2524 lio 13.46 
Xo 55 as S38. S) ohms 25. Par: 
x S25 33 ee i0le 6.63 be Jo 
Xo s.333 1.14 205 1.67 
Xi Sih Si aie! lea TAS, Zon 
Xs S23 33 lpeeeZ ifeoo” 1.57 
a Sipe eere: ee 1.40 i579 
X og 3.333 ee 220 2.45 
h(x) SOs oll, 1 Alok Os Sig SES). 82.99 
h(x) =6608— 13 Ue SRS SARs Ue 3.46 
Time 32 sec D320 SSC 150 sec 
meeernate Initial Points; 
a) x = 10.87 Elina opus 
1 
b) i) t= ieee 7 3 
= 10.0 Mies cy 23 
; = 3.26 1=24,...,46 


91 





10. 


a. 


i? « 


List of References 


IBM Technical Report~320-2947, A Comparative 
Seven Nomlancar Programming Codes, py A.R. 
Colveeie ,-wutine T9568," °° ~ —— 

HiAcGcoumleiiaeana MCCOrmigk, G.P., Nonlinear . 
Programming Sequential Unconstraiaed Uinhimization 
feeGinwcies, Tohpeiiley and Sons, inc.; T3908. 


vee idan OLnNeS en. le, and McCormick, G.P., 
A Guide to SGu%-Version 4; The Computer 
Progran Liplenshitind tie Sequentiad Unconstrained 
MINniNiZation Vecnnigque for wonlinear Progranming, 
PeseareimifalvolarCOrpolLacion, icLéan, Yas,  .*~ 
femruary 19/1. 


Office of Naval Research Technical Mtienmorandun 
CIS~75-O1, GRG Systen Documentation, by 
PeoneaceOty, etal. MAbeCN,atisv. Ndtner, and 
Weevdast. uovenmper 19/5. 


Office of Naval Research Technical Memorandua 
Cio oa ons User's Guide, Pie 
EtowbescOn, AsDs Haren, tse rkatner, and 
A. Jain, November 1975. 


Me wie caw e dna Philiztpos, D.T., "A Survey 
Se OmetiearyPLOgramming,! ALLE Transactions 
Vole NOG. 3, p 235-256 September, 1975. 


Aerospace Corporation Report No. ATR-64(/040)-2, | 
Development and Testing of a Nonlinear Prograaming 
pig@emean, byeG.we Graves, June TY04d- | 


Winstcn, A-B., "The Application of a Nonlinear 
Algorithm to a Second-Order Representation 
dimou rnonten,') Centre d'Etudes de Recherche 
Cperaehomnielte, Vor. Ti, p 75=9T, 1969. 


er SE ee 


Graves, G-W., "A Complete Constructive Algorithnn 
for the General Mixed Linear Programming Problen," 


igicdeeneoecarch LOcistics QUarteriy, Yol. 12, 


Tomei) sass tarcn, t9O5. 
ReagecOrpOrkaktion Report R=1411-DDPAE, Sortie 
Mmekecatton by a Monlinear Procramning “todel for 


by? i. ne cYrasen, 


ei 
Im 
cti 
at 
ra | 
§3| 
| 
=| 
x 
mS 
tQ 
se) 
<- 
[Ss 
eal | 
a | at 
{ 
~! 
= 
Op) 
| 

i 
of 
}ote 
pod 
«| 
| 


Himmelblau, D.M., A 
McGraw-Hill, 1972 


Peace sana MeCornick, G.P., Selected 


Applications cf Nonlinear Progranming, John 


pe ee weep ee ce ee ee ee ees 


Wiley and Sons, Tacs, 19087 


92 





13. 


14. 


iba 


16. 


fi? « 


Soma samc deenGe, ULC., "Models for Multi-iten 
Continuous Review Inventory Policies Subject 
Pome Hetmiitayu Nava Research LOGiStics Quarterly 
Volmeie, No. 4, p 451-463 Decenber, TOT. 


SecOet,eneJe, ‘A wOdel Of Nodal Entropy 
ieee Transportation Network with Congest 
PeoemoOtceanvon science Vol. 5, No. 2, 


Nia yrresio ts 


S oe 
a 
Co 
ee 


ea cla in 11 meat ee ia ee MeV ommmnRACc=LP—2/ 2, 
ie Gio ee Equilibrium Problem: An Appli cation 


Glaeser, CY Ase. Jones, 1Y¥o0T. 


ee ee ae ee ee 


Research Analysis Comp. Open REC] EP=3072, 
Ongiea tall e Wet parc erie SOL Minimization, 
BY Soe Ds, Beeresk- Miey;, 1950G. 


Pavidadniuy D.A. Ph.D. dissertation, University 
of Texas, Austin, Tex., 1969. 


93 





Cie Obst kiBULLON List 


No. Copies 


Defense Documentation Center Z 
Cameron Station 


mlexandria, Virginia 22314 


ib DGanry, Code 0212 2 
Naval Postgraduate School 


Monterey, California 93940 


Professor G. H. Bradley (Thesis Advisor) 10 
Department of Operations Analysis 
Naval Postgraduate School 


Monterey, California 93940 


Associate Professor G. G. Brown 1 
Department of Operations Analysis 

Naval Postgraduate School 

Monterey, California 93340 


Lieutenant R. J. Waterman, U. S. Navy (Student) 1 
Hanover Rcad 
Forestville, New York 14062 


Chairman 1 
Department of Operations Analysis 
Naval Postgraduate School 


Monterey, California 93940 


94 








J 
thesW22998 
An evaluation and comparison of three no 


IN 


3 2768 000 99479 2 | 
DUDLEY KNOX LIBRARY 

















































































































































































































